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MULTISCALE SHARPENING AND SMOOTHING WITH WAVELETS 

FIF.T.D OF THE INVENTION 

The present invention relates to the field of data and image 
5 processing; more particularly, the present invention relates to performing 
sharpening and smoothing on multiple scales, or levels, of a decomposition 
of a signal or image. 

BACKGROUND OF THE INVENTION 

1 0 Sharpening and smoothing is fundamental to image enhancement 

and restoration. Image enhancement refers to accentuation of features of an 
image such as edges, boundaries, or contrast, and includes noise reduction, 
edge crisping and sharpening, filtering and many often well-known 
processes. Image restoration usually involves filtering an observed image to 

1 5 minimize, as best as possible, the effort of degradation. See A.K. Jain 
Fundamentals of Digital Image Processing, and W. Pratt, Digital Image 
Processing. Sharpening and smoothing are commonly used techniques in 
digital photography and scientific and medical imaging. 

A popular sharpening method is referred to as unsharp masking 

20 which filters the image with a special highpass filter. A disadvantage of 
unsharp masking is that noise in the image is also sharpened and that the 
resulting output often looks "unnatural" since the choice of the appropriate 
degree of sharpening is difficult. 
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There exist many sharpening filters for image processing. These 
sharpening filters magnify the edges in an image, typically by highpass- 
filtering of the original image. A common method is unsharp masking as 
described in, for example, "Fundamentals of Digital Image Processing/ 7 by 
5 A.K. Jain, Prentice Hall, 1989. 

In unsharp masking, given an image f (x), a sharpened image f sharp (x) is 
obtained by adding a magnified gradient image to a smoothed 
("unsharped") version of the image, i.e. 

fsharp( X ) := f S mooJ X ) + ^ ^gradientM CO 

1 0 where A, > 1 is the sharpness parameter. The sharpness increases with 

increasing X. If the image f (x) can be written as a sum of a lowpass filtered 
image f low and a highpass filtered image f^ then Eq.(l) can be expressed as 

U,(xH 0W (x)+(Arl) f^x). (2) 
In this approach the lowpass and highpass filters are fixed. One problem 

1 5 with this approach is that a priori it is not known what filter size, filter 
coefficients, and what value for the parameter A, is appropriate. If A, is too 
large, the image looks unnatural. To overcome this problem, some 
approaches apply several filters and take that output which looks most 
"natural" (see e.g., "Real World Scanning and Halftones," Peachpit Press, 

20 Inc., Berkeley, 1993 by D. Blatner, S. Roth). 

In order to overcome the problem of sharpening not only "real" 
edges, but also noise pixels, the approach in "Adaptive Unsharp Masking 
for Contrast Enhancement," in Proceedings of the 1997 International 



Conference on Image Processing (ICIP '97), pp. 267-270, 1997, by A. Polesel, 
G. Rampoui and V.J. Mathews, adds an adaptive directional component to 
an unsharp masking filter in the pixel domain that changes the sharpening 
parameter depending on strength and orientation of an edge. The unsharp 
masking filter is a two-dimensional Laplacian. 

As mentioned above, the unsharp masking technique raises the 
problem of determining the degree of sharpening of an image that is best 
(i.e., finding the correct amount of sharpening). One solution to this 
problem is addressed in U.S. Patent No. 5,867,606, entitled "Apparatus and 
Method for Determining the Appropriate Amount of Sharpening for an 
Image," issued February 2, 1999, assigned to Hewlett-Packard Company, 
Palo Alto, California, for using the Laplacian in the unsharp masking 
technique. As a solution the magnitude of the sharpening parameter X is 
determined by matching the Fourier spectrum of the sharpened image with 
a spectrum of a low resolution version of the original image. This requires 
in addition to the unsharp masking filters, a Fourier transform on the 
original image which has a higher computational complexity than a discrete 
wavelet transform. Furthermore, only one lower resolution image is 
incorporated into the technique. 

The problem of enhancing a scanned document, such as, sharpening 
of scanned images in the JPEG domain is discussed in "Text and Image 
Sharpening of Scanned Images in the JPEG Domain, "Proceedings of the 
1997 International Conference on Image Processing (ICIP '97), pp. 326-329, 
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1997 by V. Bhaskaran, K. Konstantinides and G. Beretta. One proposed 
solution consists of a scaling of the encoding quantization tables to enhance 
high frequencies. The amount of scaling depends on the energy contained in 
the corresponding DCT coefficients. Since DCT functions form only a basis 
5 in V (R), but not in more sophisticated smoothness spaces as, e.g., Hoelder 
spaces C ot (R) / JPEG compression introduces blocky artifacts, a well-known 
problem in JPEG-compressed images. Those artifacts can be even magnified 
by scaling the DCT coefficients. 

Wavelet coefficients have been modified for the purpose of contrast 
1 0 enhancement in images using criteria such as minimizing the mean-squared- 
error. However, these approaches do not consider the theoretical 
smoothness properties of an image in terms of local regularity and are 
computationally more complex. 

In the prior art, detail versions of the image have been processed. 
1 5 Such an approach is described in U.S. Patent No. 5,805,721, "Method and 
Apparatus for Contrast Enhancement," issued September 8, 1998, assigned 
to Agfa-Gevaert, Belgium. In this approach, the image is decomposed into 
detail images at different resolutions and a lowpass image. This 
decomposition is not a subband decomposition, but a Laplacian pyramid 
20 where the reconstruction process consists of simply adding detail and 
lowpass images. The detail coefficients are multiplied with factors that 
depend on the magnitude of wavelet coefficients. This multiplication can be 
described by evaluating a monotonic function. This function has power-law 
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behavior, but does not change over scales. In a renormalization step, the 
pixels in the detail images are first normalized by the possible maximum of 
the pixels in the detail images. There is no discussion on how to choose the 
parameter contained in the monotonic function. 
5 Modifications of wavelet coefficients have also been made based on 

energy criteria. For example, contrast enhancement in images by modifying 
wavelet coefficients based on energy criteria is described in "De-Noising and 
Contrast Enhancement Via Wavelet Shrinkage and Nonlinear Adaptive 
Gain," Proceedings of the SPIE, Vol. 2762, pp. 566-574, Orlando, Florida, 

1 0 1996 by X. Zong, A.F. Laine, E.A. Geiser and D.C. Wilson. One problem 
with this approach is that many computations are required because a 
comparison of local energy is performed for each individual wavelet 
coefficient. Furthermore, the modifications only apply to critically sampled 
wavelet transforms. 

1 5 Embodiments of the present invention avoid or overcome one or 

more of the above mentioned problems. 



SUMMARY OF THE INVENTION 

A method and apparatus for processing image data are described. In 
one embodiment, a method of processing image data comprises 
decomposing the image data into multiple decomposition levels by applying 
a wavelet transform to the image data, and modifying coefficients in at least 
two of the decomposition levels by scaling coefficients in these 
decomposition levels using different scale dependent parameters for each of 
the decomposition levels. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will be understood more fully from the 
detailed description given below and from the accompanying drawings of 
various embodiments of the invention, which, however, should not be taken 
5 to limit the invention to the specific embodiments, but are for explanation 
and understanding only. 

Figure 1 illustrates one embodiment of a method for processing 
image data. 

10 

Figure 2 illustrates another embodiment of the process for processing 
image data. 



Figure 3 illustrates a block diagram of filter bank implementation of 
1 5 the first level of multiscale unsharp masking with a discrete wavelet 
transform. 



Figure 4 illustrates another block diagram of a filtering 
implementation of the first level of multiscale unsharp masking with an 
20 overcomplete discrete wavelet transform. 



Figure 5 illustrates a flow chart of one embodiment of the process for 
performing multi-scale sharpening and smoothing with wavelets. 
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Figures 6A-D illustrate forward and reverse transforms. 

Figures 7A-D illustrate the application of sharpening/smoothing to 
5 RDWTs. 

Figure 8 is a block diagram of one embodiment of a copier. 



1 



10 

DETAILED DESCRIPTION 

A multiscale sharpening and smoothing technique with wavelets is 
described. In the following description, numerous details are set forth, such 
as specific filters, etc. It will be apparent, however, to one skilled in the art, 
5 that the present invention may be practiced without these specific details. In 
other instances, well-known structures and devices are shown in block 
diagram form, rather than in detail, in order to avoid obscuring the present 
invention. 

Some portions of the detailed description which follow are presented 
10 in terms of algorithms and symbolic representations of operations on data 
bits within a computer memory. These algorithmic descriptions and 
representations are the means used by those skilled in the data processing 
arts to most effectively convey the substance of their work to others skilled 
in the art. An algorithm is here, and generally, conceived to be a self- 
1 5 consistent sequence of steps leading to a desired result. The steps are those 
requiring physical manipulations of physical quantities. Usually, though 
not necessarily, these quantities take the form of electrical or magnetic 
signals capable of being stored, transferred, combined, compared, and 
otherwise manipulated. It has proven convenient at times, principally for 
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reasons of common usage, to refer to these signals as bits, values, elements, 
symbols, characters, terms, numbers, or the like. 

It should be borne in mind, however, that all of these and similar 
terms are to be associated with the appropriate physical quantities and are 
5 merely convenient labels applied to these quantities. Unless specifically 
stated otherwise as apparent from the following discussion, it is appreciated 
that throughout the description, discussions utilizing terms such as 
"processing" or "computing" or "calculating" or "determining" or 
"displaying" or the like, refer to the action and processes of a computer 

1 0 system, or similar electronic computing device, that manipulates and 

transforms data represented as physical (electronic) quantities within the 
computer system's registers and memories into other data similarly 
represented as physical quantities within the computer system memories or 
registers or other such information storage, transmission or display devices. 

1 5 The present invention also relates to apparatus for performing the 

operations herein. This apparatus may be specially constructed for the 
required purposes, or it may comprise a general purpose computer 
selectively activated or reconfigured by a computer program stored in the 
computer. Such a computer program may be stored in a computer readable 
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storage medium, such as, but is not limited to, any type of disk including 
floppy disks, optical disks, CD-ROMs, and magnetic-optical disks, read-only 
memories (ROMs), random access memories (RAMs), EPROMs, EEPROMs, 
magnetic or optical cards, or any type of media suitable for storing electronic 
instructions, and each coupled to a computer system bus. 

The algorithms and displays presented herein are not inherently 
related to any particular computer or other apparatus. Various general 
purpose systems may be used with programs in accordance with the 
teachings herein, or it may prove convenient to construct more specialized 
apparatus to perform the required method steps. The required structure for 
a variety of these systems will appear from the description below. In 
addition, the present invention is not described with reference to any 
particular programming language. It will be appreciated that a variety of 
programming languages may be used to implement the teachings of the 
invention as described herein. 

Overview 

Techniques for multiscale sharpening and smoothing of data with 
wavelets, such as image data, are described herein. The multiscale 
sharpening and smoothing techniques described herein, also referred to as 
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multiscale unsharp masking, provides an alternative to the prior art 
methods described above and is simple to implement. This approach uses 
the smoothness properties of wavelet systems to provide the sharpening and 
smoothing, 

5 Specifically, the techniques described herein sharpen and smooth 

images over various levels of resolutions using a new 
sharpening /smoothing parameter. In one embodiment, the multiscale 
sharpening and smoothing is implemented in a wavelet decomposition by 
multiplying wavelet coefficients with a scale-dependent parameter. Figure 1 

1 0 illustrates one embodiment of a method for processing image data. The 
method is performed by processing logic, which may comprise hardware, 
software or a combination of both. Referring to Figure 1, the process begins 
by decomposing the image data into multiple decomposition levels by 
applying a wavelet transform to the image data (processing block 101). The 

1 5 transform that is applied to the image data may comprise, for example, a 
critically sampled discrete wavelet transform, an overcomplete discrete 
wavelet transform, a complex wavelet transform, a critically sampled or 
overcomplete wavelet packet transform. In one embodiment, the image 
data is transformed into multiple decomposition levels using a critically 

20 sampled transform for selected subbands an overcomplete transform in 
others. 

Then, after performing the decomposition, the process modifies 
coefficients in multiple decomposition levels by scaling coefficients in those 
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decomposition levels using different scale, or level, dependent parameters 
for each of the decomposition levels (processing block 102). For example, 
where scaling two levels, each coefficient in one of the decomposition levels 
is multiplied by a first scale dependent parameter and each coefficient in 
5 another of the decomposition levels is multiplied by a second scale 
dependent parameter. 

In one embodiment, each of the different scale dependent parameters 
is determined according to the following formula: 

h = 2 a (3) 

1 0 where the value of a (positive or negative) indicates whether sharpening or 
smoothing is applied to coefficients and ] indicates the particular scale 
(level). In one embodiment, sharpening is applied to coefficients if a is less 
than zero and smoothing is applied to coefficients if a is greater than zero. 
Thus, if \i } is greater than 1, then the result of the scaling operation is 

1 5 smoothing, while if ^ is less than 1, then the result of the scaling operation is 
sharpening. The rescaling is applied only to wavelet (detail) coefficients, not 
scaling coefficients. In order to preserve the total energy of the image, a 
renormalization of the wavelet coefficients may be necessary. 

In one embodiment, the scale dependent parameter is selected based 

20 on knowledge of the image data. That is, information extracted directly 
from the image can be incorporated in the choice of the sharpening or 
smoothing parameter. For example, knowledge that the input data indicates 
step edges may be used to select the sharpening or smoothing parameter. 
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Knowledge of the source of the image, e.g., scanner, may also be the basis of 
the selection of the sharpening or smoothing parameter. For example, this 
knowledge could be information on the point spread function in a scanner 
or other image source. In still another embodiment, the scale dependent 
5 parameter may be selected based on a monotonic function. The scale 

dependent parameter may be selected based on an estimate of the decay of 
wavelet coefficients across scales. 

Referring back to Figure 1, after performing the multiscale sharpening 
and/or smoothing, processing logic performs an inverse transform on scaled 
1 0 (and unsealed) coefficients (processing block 103). 

This technique may be combined with other wavelet-based image 
processing methods such as, for example, denoising. That is, multiscale 
sharpening and smoothing may be combined with other image processing 
steps in the wavelet domain. It has been shown in many applications that 
1 5 wavelet denoising is successful because edges are kept sharp whereas the 
noise is removed in smooth regions. This denoising can be simply done by 
thresholding wavelet coefficient. Suitable thresholding techniques include 
hard and soft thresholding. See, for example, Donoho, D.L. "De-noising by 
Soft-Thresholding, IEEE Trans. Inform. Theory, 41(3):613-627, 1995. 
20 In one embodiment, simultaneously denoising and sharpening may 

be performed on wavelet coefficients by multiplying all coefficients above a 
predetermined threshold by a scaling parameter and setting all coefficients 
in the same decomposition level below a threshold to zero or to a value near 
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zero. In one embodiment, all the values of coefficients are reduced by a 
predetermined amount that might be given by a monotonic function. The 
resulting coefficients are then multiplied with the scale dependent 
parameter. 

5 In the presence of random White Gaussian Noise, one advantage of 

the combined denoising and sharpening/ smoothing technique is that the 
denoising threshold can be computed directly from wavelet coefficients and 
the amount of input data, but does not depend on the actual signal. 
Whereas with traditional sharpening the problem of sharpening not only 

10 "real" edges, but also noise pixels, occurs wavelet sharpening and denoising 
can be done, for example, by choosing a threshold, multiplying all 
coefficients above that threshold by \l= 2 ,a and setting all coefficients below 
a threshold to zero. This leads to easy implementation of signal adaptive 
smoothing and sharpening as needed or required, e.g., in a digital copier. 

15 A common model for noise in data is additive Gaussian White noise. 

A technique developed by Donoho and Johnstone for denoising with 
wavelets is a state of the art denoising technique. The denoising is 
performed by simply thresholding wavelet coefficients. The threshold 
depends only on the size of the data N, where N is the number of samples 

20 (for an image, the number of samples is the number of pixels) and the 
standard deviation of the noise a, the threshold is: 

(7^/2 log iV 
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The latter parameter can be estimated from the standard deviation of the 
first level of wavelet coefficients. Asymptotically, all noise should be 
removed as N goes to infinity using that technique. However, in practical 
application, there may still be some noise present in the data due to the 
5 finiteness of the data or different threshold selection. It is also known that 
the human visual system corresponds positively to some noise present in, 
for example, images. After the rescaling (sharpening or smoothing) of 
wavelet coefficients described herein, the inverse transform transforms the 
remaining White noise into Colored noise (e.g., coloring remaining noise). 

1 0 Similarly, the wavelet coefficients may have to be renormalized, 

particularly to maintain the proportions of modified wavelet coefficients and 
original scaling coefficients as described in more detail below. The 
renormalization may be performed by applying a scalar to the coefficients in 
all levels or a subset of all levels. In one embodiment, renormalization may 

15 be combined with the sharpening or smoothing by multiplying all 

coefficients at one or more of the decomposition levels by a scale dependent 
parameter chosen to achieve renormalization and sharpening/ smoothing. 
In an alternative embodiment, renormalization may be performed by 
computing a range of wavelet coefficients (e.g., the minimum and maximum 

20 coefficient values) before rescaling, and then perform the rescaling 
(sharpening or smoothing). Thereafter, the complete set of modified 
coefficients are scaled back to the original range (e.g., mapping the 
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smoothed or sharpened coefficients back into the original range specified by 
the minimum and maximum coefficient values) before the rescaling. 

Figure 2 illustrates another embodiment of the process for processing 
image data. The process is performed by processing logic that may 
5 comprise hardware, software, or a combination of both. Referring to Figure 
2, the process begins by processing logic decomposing the image data into 
multiple decomposition levels by applying a wavelet transform to the image 
data (processing block 201). 

Once decomposition has been completed, then processing logic 
1 0 classifies the coefficients at different decomposition levels and bands 

(processing block 202). This classification is optional. In one embodiment, 
coefficients are classified into "text" and "background" depending on a 
predetermined criterion. The resulting classification may be used for 
adapting the smoothing or sharpening to compensate for the type of data 
1 5 being processed. 

Then, processing logic performs denoising on coefficients in one or 
more of the decomposition levels (processing logic 203). 

After performing the decomposition and classification, the processing 
logic modifies in multiple decomposition levels by scaling classified 
20 coefficients in those decomposition levels using different scale (level) 
dependent parameters for each of the decomposition levels (processing 
block 204). In one embodiment, the parameters may be band dependent 
parameters. For a ID transform, there is one band (or subband) for each 
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scale (level). For 2D or higher dimensional transforms, each band is a 
particular scale (level) and orientation. For example, a two 2D transform has 
a band for the first scale (level) and for the vertical detail (high-pass) and the 
horizontal smooth (low-pass). 

After sharpening or smoothing has been performed, processing logic 
performs renormalization on the coefficients (processing block 205) on all 
levels or a subset of all levels. Once renormalization has been performed, 
processing logic performs an inverse transform on scaled (and unsealed) 
coefficients (processing block 206). 

Note that techniques for sharpening and smoothing described herein 
are advantageous in that "real" edges are magnified over various scales 
more than noise pixels and smooth areas are smoothed over various scales. 
The techniques may also outperform the traditional unsharp masking with 
respect to the quality of the processed image. 

Sharpening /Smoothing Theory 

The theory behind the sharpening and smoothing techniques of the 
present invention, is described below. In the following, a description is 
given as to how these results can be used for deriving multiscale unsharp 
masking via discrete wavelet decompositions. 

Let {H,H*,G,G*} be a quadruple of biorthogonal wavelet filters (H = 
lowpass, G = highpass), where H and G are used in the forward transform 
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and H* and G* in the inverse transform. In the Z-transform domain a 2- 
channel perfect reconstruction filter bank is required to satisfy the following 
conditions (see e.g., G. Straug, T. Nguyen, "Wavelets and Filter Banks/' 
Wellesley-Cambridge Press, 1996). 

H*(z) H(z) + G*(z) G(z) = 2 z m (4) 
H*(z) H(-z) + G*(z) G(-z) = 0. (5) 
As a consequence the following equality, also known as perfect 
reconstruction property, is guaranteed for an arbitrary signal X: 

z m X(z) = Vi [H*(z)H(z)X(z) + H*(z)H(-z)X(-z)] + Vi [G*(z)G(z)X(z) + G*(z)G(-z)X(-z)]. 
Introducing the following notations: 

F 0 [X](z) := Vi [H*(z)H(z)X(z) + H*(z)H(-z)X(-z)] (lowpass output) and 

FJX](z) := V2 [G*(z)G(z)X(z) + G*(z)G(-z)X(-z)] (highpass output) 

the perfect reconstruction property can be rewritten as 

z m X(z) = F 0 [X](z) + F 1 [X](z). (6) 

If the filters H and G are symmetric and centered around zero the delay is 

zero, i.e. m=0. 

Since F 0 is a lowpass and F 2 is a highpass filter, there exists a wavelet 
formulation of the definition of a sharpened image F dwt . s (x) by 
x^M-FoM^ + liFJxKz). (7) 
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where the wavelet sharpening parameter is equivalent to the parameter k 
in the traditional sharpening method in Eq(l). 

When computing scaling and wavelet coefficients at larger 
decomposition levels, the input data X are the scaling coefficients s' at a 
5 specific scale j. The wavelet sharpening parameter \l can differ from scale to 
scale (i.e., level to level). The results from the theory of smoothness spaces, 
which is described in, for example, Y. Meyer, "Wavelets and Operators," 
Cambridge University Press, Cambridge, WC, 1992, lead in a natural way to 
a definition of multiscale sharpening by choosing a scale-dependent 
1 0 sharpening parameter. 

\i t = 2 ,a . with a<0 (8) 
The parameter a changes the overall smoothness of the signal in terms of 
Hoelder regularity. 

The "sharpened" scaling coefficients s' dwt ^ at scale j are then defined as 
15 s' dw , s = F 0 [s j ] + u^ls']. (9) 

Analogous to the theoretical results on smoothness characterization, the 
parameter choice a<0 sharpens the image. The range of a is bounded by 
constraints given through the chosen wavelet system. A block diagram of a 
first stage of a filter bank implementation of this method is shown in Figure 
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3. Referring to Figure 3, an input signal X is input into a low pass (H) 
wavelet filter 301 and a high pass (G) filter 302. The outputs of filters 301 
and 302 are coupled to decimation units 303 and 304, respectively, which 
decimate the signals from filters 301 and 302 by two (critically subsampled). 
5 Line 305 represents the separation between the analysis portion and the 

synthesis portion of the system shown in Figure 3. Although not shown, the 
low pass transferred signals may be input into filters 301 and 302 iteratively 

to create additional decompositional levels with parameter m|ij. This 

process may be repeated to create any number of decomposition levels (e.g., 

10 2, 3, 4, 5, etc.). 

Between the analysis portion and the synthesis portion, a coder and 
decoder may be included (not shown to avoid obscuring the invention). The 
coder and decoder may contain all the processing logic and/or routines 
performed in the transformed domain (e.g., prediction, quantization, coding, 

15 etc.). 

The critically subsampled signals that are output from decimation 
unit 304 are input to scaling unit 306 (after any coding and decoding). 
Scaling unit 306 applies different scale dependent parameters (I to 
transformed signals of multiple decomposition levels. 
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The subsampled transformed signals that are output from decimation 
unit 303 and the scaled output from scaling unit 306 are input to upsampling 
units 307 and 308, respectively, which upsamples the transformed signals by 
2 (e.g., a zero is inserted after every term) and then passes the signals to low 
5 pass inverse wavelet transform filter 309 and high pass inverse wavelet 
transform filter 310, respectively. The outputs of filters 309 and 310 are 
combined by addition unit 311 to produce an output signal X\ Addition 
unit 311 adds its two inputs. In alternative embodiments, addition unit 311 
may write to alternating locations in memory (e.g., frame buffer) or store the 
1 0 information using addresses selected to result in the combined output. 

In order to preserve the total energy of the image and to maintain the 
proportions of modified wavelet and original scaling coefficients a 
renormalization of wavelet coefficients may be used. In one embodiment, 

this is done by dividing the modified coefficients by ^n^T where 

15 

9 (L+l)2y o2y 

/ 22y-1 for-a^y. (10) 



)(L+l)2(y+a) _ 22(r+«) 



>2(r+o) , 
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>2y 



1 



for -a=y . 



(11) 



y is the upper bound on the Hoelder regularity range of the wavelet system 
and a is the chosen sharpening parameter. For a Daubechies-8 wavelet 
system of order 4 (filter length = 8, y = 1.596 with a = -1.596 the 
5 normalization factor results in 





' 2<L+1)-3.192 


_ 2 3.192 - 




2 3.192 


-1 



(12) 

Hoelder regularity and vanishing moments for various Daubechies wavelet 
systems from the book by Ingrid Daubechies, "Ten Lectures on Wavelets," 
1 0 SIAM, Philadelphia, PA, 1992 are shown in Table 1 below: 

Table 1 



Daubechies 






T 


wavelet system 


Hoelder 


Vanishing 


=min(Hoelder, 


of order N 


regularity 


moments 


vanishing 








moments) 


1 




1 




2 


>05 


2 


>0.5 


3 


>0.915 


3 


>0.915 


4 


>1.596 


4 


>1.596 


5 


£1.888 


5 


>1.888 


6 


>2.158 


6 


>2.158 
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The parameter y is the minimum of vanishing moments and Hoelder 
regularity. Alternative renormalization techniques may be used. 

The lack of shift-invariance of the critically sampled DWT is a 
disadvantage for image processing steps such as denoising and also 

5 multiscale smoothing and sharpening because one particular edge could be 
smoothed or sharpened differently depending on the alignment of the edge 
in the wavelet tree. To overcome this disadvantage, an overcomplete 
(redundant) DWT, denoted by RDWT, is chosen and outperforms the 
critically sampled DWT. If an RDWT is chosen for sharpening an image, the 

1 0 same approach as described above may be used to define a multiscale 

unsharp masking. The main difference is that down- and up-sampling steps 
in the filter bank are neglected. 

The perfect reconstruction property of the RDWT at scale 1 is given 

by 

1 5 x(z) = Vi (H* H[x](z) + G* G[x](z)). (13) 

A schematic overview is shown in Figure 4. Referring to Figure 4, an input 
signal X is input to low pass wavelet transform filter 401 and high pass 
wavelet transform filter 402. The output of filter 401 is separated into even 
coefficients 403 and odd coefficients 404, and the output of filter 402 is 



26 

separated into even coefficients 405 and odd coefficients 406. Note that no 
decimation is performed. As with line 305 of Figure 3, line 407 again 
represents the separation between the analysis and synthesis portions and 
may include coding and decoding operations as described herein. Also, the 
coefficients output from low pass filter 401 may be fed back into filters 401 
and 402 iteratively to create a number of decomposition levels. 

Scaling units 408 and 409 apply a scale dependent parameter to the 
even and odd coefficients as described above to multiple decomposition 
levels. The outputs of scaling units 408 and 409 and the even and odd 
coefficients from filter 401 are upsampled by upsampling units 410-413. The 
outputs of upsampling units 410 and 411 are coupled to inputs of low pass 
inverse transform filters 414 and 415 respectively, and the outputs of 
upsampling units 412 and 413 are coupled to inputs of high pass inverse 
transform filters 416 and 417 respectively. The outputs of inverse filters 414- 
417 are coupled to divider units 418-421, which divide the outputs by 2 to 
results in averaging two numbers to compensate for the use of an 
overcomplete DWT. The renormalization proceeds along the same lines as 
for a DWT, just the value gamma for the wavelet system is, roughly 
speaking, doubled (see table). 
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Addition unit 422 adds the outputs of decoder units 418 and 419, 
while addition unit 423 adds the outputs of divider units 420 and 421. 
Addition unit 424 adds the outputs of addition units 422 and 423 to create 
the X 1 signal. Addition units 422-424 may operate in a well-known manner, 
such as, for example, described above. 

If the filters H and G are orthogonal the filters H*H and G*G in the 
first stage of the filter bank are simply the autocorrelation filters of H and G. 

For scales j > 1 the perfect reconstruction property is expressed using 
not the original filters H,H*,G/G*, but iterated versions of those, denoted by 
H,;H* ,G ;/ G* , as follows: 

s'- 1 (z) = % (H*H, [s H ] (z) + G*G, [s'1 (z) ). 

In analogy with the critically sampled case, a sharpened image x rdwt _ s can be 
defined as 

x rd _ :=l/2 (H* H [x] + ji G*G [x]). (14) 
By choosing |i J = 2 ,a sharpened (a<0) late scaling coefficients may be obtained 
by 

S 1 ^. =1/2 (H* H [S 1 ] + m G*G [S 1 ]). (15) 
at scale j=l. For scales j>l the sharpened scaling coefficients are defined as 
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SL* =l/(2 ,+1 ) (H* H, [S>] + |Xj G» G, [SI). (16) 

The filter bank implementation for overcomplete multiscale sharpening is 
shown in Figure 4. Compared to the maximal decimated filter bank 
structure in Figure 3, the down-sampling by a factor of two is neglected. But 
5 in the same way as in Figure 3, the detail coefficients are multiplied by |i. In 
contrast to the critically sampled DWT, the range of possible exponents is 
extended. 

The normalization of modified wavelet coefficients may be performed 
in the same way as for the critically sampled DWT. The renormalization 
1 0 proceeds along the same lines as for a DWT, except that the value a for the 
wavelet system is, roughly speaking, doubled. For overcomplete 
transforms, the values change as shown in Table 2 below: 

Table 2 



Daubechies 
wavelet system 
of order N 


Y 

Hoelder Vanishing =min(Hoelder, 
regularity of moments of vanishing 
overcomplete overcomplete moments) 

system systems 


1 


>1 2 1 


2 
3 
4 
5 
6 


>1.0 4 1.0 
>1.830 6 1.830 
>3.192 8 3.192 
>3.776 10 3.776 
>4.316 12 4.316 
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Similarly to multiscale sharpening for critically sampled and 
overcomplete wavelet transforms, multiscale smoothing is possible for 
critically sampled and overcomplete wavelet transforms by choosing the 
5 parameter a to be greater than zero. 

There are some advantages of knowing the smoothness of the original 
data and the processed input data. Assume the input data is a smoothing of 
the original data by rescaling wavelet coefficients obtained from applying an 
orthogonal DWT, then the technique described herein can reconstruct the 
1 0 original data exactly. For example, it means that a smoothed step edge in 
the processed input data can be reversed to the original step edge. 

Multiscale smoothing and sharpening using a DWT with orthogonal 
wavelets is invertible, while, in contrast, the RDWT is not invertible. The 
reason for this is that the RDWT is not an orthogonal transform and, in 
1 5 general, 

Vi H (H* H[x]+ji G* G[x]) + Vi G (H* H[x]+|i G* G[x]) * H[x]+|i G[x].(17) 

Figure 5 illustrates a flow chart of one embodiment of the process for 
performing multi-scale sharpening and smoothing with wavelets. Referring 
20 to Figure 5, the process begins with processing logic receiving input 
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parameters (processing block 501). In one embodiment, the input 
parameters comprise the type of wavelet system, the number of 
decomposition levels, the sharpening/ smoothing parameter, and the 
denoising technique. With respect to the denoising technique, the input 
5 parameters comprise thresholds for the denoising technique. 

Once the input parameters have been received, processing logic looks 
up the smoothness value y for the chosen wavelet system (processing block 
502) and computes the renormalization factor are using the formula given 
above (processing block 503). The valves of y may be stored in a look up 
1 0 table, with each entry being associated with a different wavelet system. The 
processing blocks 501-503 represent an initialization portion of the process. 
These steps are performed once, with the remaining steps being performed 
for every image. 

After initialization, processing logic performs a first level wavelet 
1 5 transform (processing block 504). Processing logic then sets the threshold 
for denoising (processing block 505). In one embodiment, if the Donoho - 
Johnstone threshold is used for denoising, processing logic computes the 
standard deviation of wavelet coefficients and sets the threshold to: 
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where N is the maximum of the rows and columns of the data and a is the 
standard deviation of the first level of wavelet coefficients. 

Next, processing logic performs the second level wavelet transform 
on the coefficients (processing block 507 2 ). Processing logic performs other 
wavelet transforms up to the L-th level of the wavelet transform (processing 
block 507 L ). 

After performing the wavelet transforms, processing logic performs 
thresholding (denoising) and rescaling (sharpening or smoothing) by 
multiplying wavelet coefficients at level j with: 

2 Ja 

(processing block 508). Thereafter, processing logic performs L levels of the 
inverse transform (processing block 509). 

Figures 6A-D illustrate forward and inverse transform. Figure 6A 
and B illustrate building blocks for the forward and inverse discrete wavelet 
transform (DWT) respectively. Note that these are similar to the similarly 
named blocks in Figure 3. Figure 6C is one embodiment of a forward DWT 
for L levels of decomposition. Referring to Figure 6C, the input X is input 
into the level one forward DWT block 601. The output of the level one 
forward DWT 601 is input to the level two forward DWT block 602 and 
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continues through the remaining levels of decomposition to level L in 
similar fashion. Figure 6D illustrates the inverse DWT with rescaling 
(sharpening/ smoothing) L levels of decomposition. Referring to Figure 6D, 
noted that there is a sharpening/smoothing parameter for each level of the 
5 inverse DWTs. That is, the sharpening/smoothing parameter is the same for 
all transform steps being performed on the same level. 

Figures 7A-D illustrate the application of sharpening/smoothing to 
RDWTs. Figures 7A-7B illustrate the building block for forward and inverse 
redundant DWT (RDWT), respectively. Figure 7C illustrates a forward 

1 0 RDWT for L levels of decomposition. Figure 7D illustrates the inverse 
RDWT for all levels of decomposition with rescaling 
(sharpening/ smoothing) for L levels of decomposition. Referring to Figure 
7D, the rescaling parameter is the same for each of the individual processing 
blocks in each level. However, the rescaling parameter may be different 

1 5 from level to level. 

Selecting the Sha rpening/Smoothing Parameter 

Depending on knowledge about the smoothness of the input data and 
output data, there are different possibilities to determine the parameter a. 
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Four different techniques are described below; however, other techniques 



may be used. First, if the available input data are data obtained from 
sending original data through an input device, such as a scanner, the 
Hoelder regularity of the data is that of the input device. In case of the 
5 scanner, the regularity is given by the smoothness of the pointspread 



10 parameter shouldbeoc = 0 if p >yande>y, and a = min(y,e) - (3 if p < y. 

If the knowledge of the smoothness of the input data does not exist, 
the corresponding Hoelder regularity £ can be estimated from the decay of 
wavelet coefficients across scale. The Hoelder regularity € should be the 
smallest number such that 



function. If the original data have smoothness (5 and the scanned input data 
have smoothness e, then a reasonable choice for the sharpening parameter 
would be -(e- 3). However, the term | s— 3 1 is not allowed to be larger than 
y, the Hoelder regularity of the wavelet system. Therefore, the sharpening 



15 




for a constant C>0 and scales j and positions k. 



If the original data contain step edges as occurs, in the text regions, for 
example the original smoothness (3 is equal to zero. 
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Given the smoothness p of the original data the sharpening /smoothing 
parameter a should be always chosen such that that 0<f3+a<y. 

When processing a scanned image, the exponent a = -1 may be used, 
which has a theoretical reason. An image can be modeled as a function that 
consists of smooth regions and step edges. By scanning this image, the step 
edges get blurred. This blurring can be modeled as a convolution with a 
Gaussian kernel or a kernel of similar characteristic. As a consequence, the 
overcomplete wavelet decomposition with the Haar system will capture a 
decay of wavelet coefficients described by the exponent 1. In order to 
sharpen the scanned image, i.e. to reverse smoothing of the edges, the 
exponent a = -1 is chosen as an exponent in the sharpening parameter. The 
parameter y in the normalization constant in Eq.(lO) above is y = 1. In this 
case for a total decomposition level L=3, the following modifications of the 
wavelet coefficients have to be made: 

• multiplication of the first level of wavelet coefficients by 

(2" 1 )/ A /9/(2 8 - 4)=2.6458 

• multiplication of the second level of wavelet coefficients by 

(2" 2 )/79/(2 8 - 4) =1.3229 

• multiplication of the third level of wavelet coefficients by 

(2- 3 )/V9/(2 8 - 4). =0.6614 
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Thus, a general scheme has been described of how to choose the 
sharpening parameter in applications that involve scanned documents, e.g., 
in a digital copier, a digital camera, facsimile machine, printer, etc. 

Another application of the multiscale sharpening and smoothing is to 
5 perform an adaptive smoothing or sharpening depending on the wavelet 
coefficients. Therefore, that only selected coefficients get sharpened by 
multiplication with 2 ,0t with a<0 and coefficients in smooth areas get 
smoothed by multiplication by 2 ,p with f3>0 with a overcomplete Haar 
system. 

1 0 One embodiment of a digital copier is shown in Figure 8. Referring to 

Figure 8, a scanner 801 or other halftone image source 802 supplies an image 
to classifier unit 803, which classifies the image data as text and background. 
The output of classifier unit 803 is received by scaling unit 804 which 
performs smoothing or sharpening depending on the classified pixel. Note 

1 5 that the use of classification and basing the sharpening/smoothing on the 
classification is optional. The output of scaling unit 804 is coupled to 
processing unit 805 which performs other processes (e.g., downsampling, 
gamma correction, halftone, etc.). The output of processing unit 805 is 
received by printer 806, which prints the image. 
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Whereas many alterations and modifications of the present invention 
will no doubt become apparent to a person of ordinary skill in the art after 
having read the foregoing description, it is to be understood that any 
particular embodiment shown and described by way of illustration is in no 
5 way intended to be considered limiting. Therefore, references to details of 
various embodiments are not intended to limit the scope of the claims which 
in themselves recite only those features regarded as essential to the 
invention. 



10 



Thus, a method and apparatus for performing data processing has 
been described. 
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CLAIMS 

I claim: 

1 1. A method comprising: 

2 receiving input data; and 

3 performing multi-scale unsharp masking on the input data. 

1 2. A method for processing input data comprising: 

2 decomposing the input data into a plurality of decomposition levels 

3 by applying a wavelet transform to the input data; and 

4 modifying coefficients in at least two of the plurality of 

5 decomposition levels by scaling coefficients in the at least two 

6 decomposition levels using different scale dependent parameters for each of 

7 the decomposition levels. 

1 3. The method defined in Claim 2 wherein the input data 

2 comprises image data. 

1 4. The method defined in Claim 2 wherein only wavelet 

2 coefficients are scaled. 



1 
2 



5. The method defined in Claim 2 wherein modifying coefficients 
comprises multiplying each coefficient in one of the decomposition levels by 



9 
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3 a first scale dependent parameter and multiplying each coefficient in another 

4 of the decomposition levels by a second scale dependent parameter 

1 6. The method defined in Claim 2 wherein each of the different 

2 scale dependent parameters is determined according to the following 

3 formula: 

4 u. = 2 ,a 

5 where the value of a indicates whether sharpening or smoothing is applied 

6 to coefficients and j indicates the scale. 

1 7. The method defined in Claim 6 wherein sharpening is applied 

2 to coefficients if a is less than zero and smoothing is applied to coefficients if 

3 a is greater than zero. 

1 8. The method defined in Claim 2 wherein modifying coefficients 

2 results in smoothing of coefficients for scale dependent parameters greater 

3 than a transition value and results in sharpening of coefficients for scale 

4 dependent parameters less than the threshold value. 



1 
2 



9. The method defined in Claim 8 wherein the transition value is 

1. 
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10. The method defined in Claim 2 wherein the transform 
comprises a critically sampled discrete wavelet transform. 

11. The method defined in Claim 2 wherein the transform 
comprises an overcomplete discrete wavelet transform. 

12. The method defined in Claim 2 wherein the transform 
comprises a complex wavelet transform. 

13. The method defined in Claim 2 wherein the transform 
comprises a critically sampled wavelet packet transform. 

14. The method defined in Claim 2 wherein the transform 
comprises an overcomplete wavelet packet transform. 

15. The method defined in Claim 2 wherein decomposing the 
image data comprises applying a transform to the input data wherein the 
transform comprises an overcomplete transform for selected subbands. 

16. The method defined in Claim 2 further comprising selecting 
the scale dependent parameter based on knowledge of the input data and 
knowledge of the image source. 



1 

2 
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17. The method defined in Claim 16 wherein the knowledge of the 
image source comprises a model point spread function of the image source. 



1 18. The method defined in Claim 16 wherein the knowledge of the 

2 data comprises an indication the data contains step edges. 

1 19. The method defined in claim 16 wherein selecting the scale 

2 dependent parameter is based on an estimate of decay of wavelet 

3 coefficients across scales. 



1 20. The method defined in Claim 2 further comprising performing 

2 an inverse transform on coefficients after scaling has been performed. 

1 21. The method defined in Claim 2 further comprising denoising 

2 after applying the wavelet transform. 

1 22. The method defined in Claim 21 further comprising 

2 performing denoising as part of scaling coefficients by multiplying all 

3 coefficients in one of the decomposition levels above a predetermined 

4 threshold and setting other coefficients to a value near zero. 



1 



23. The method defined in Claim 22 wherein the value is zero. 
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1 24. The method defined in Claim 24 further comprising 

2 performing denoising as part of scaling coefficients by reducing all 

3 coefficients by a predetermined amount to a value near zero and then 

4 multiplying all coefficients in one of the decomposition levels above a 

5 predetermined threshold and reducing all coefficients by a predetermined 

6 amount to a value near zero. 



1 25. The method defined in Claim 24 wherein the value is zero. 

1 26. The method defined in Claim 21 further comprises coloring 

2 noise that remains after scaling coefficients. 

1 27. The method defined in Claim 2 wherein the different scale 

2 dependent parameters are based on desired smoothness and sharpness. 

1 28. The method defined in Claim 2 further comprising 

2 renormalizing coefficients. 



1 29. The method defined in Claim 28 wherein renormalizing 

2 coefficients comprises applying a scalar to coefficients in at least one 

3 decomposition level. 
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1 30. The method defined in Claim 28 wherein renormalizing 

2 coefficients is performed as part of scaling coefficients by multiplying all 

3 coefficients in one of the decomposition levels by a scale dependent 

4 parameter chosen to achieve renormalization. 

1 31. The method defined in Claim 28 wherein renormalizing 

2 coefficients is performed as part of scaling coefficients by computing a range 

3 of wavelet coefficients before rescaling, performing rescaling, and then 

4 scaling modified coefficients back to the range before rescaling. 

1 32. The method defined in Claim 2 wherein the scale dependent 

2 parameters comprise monotonic functions. 

1 33. The method defined in Claim 2 further comprising classifying 

2 wavelet coefficients into types. 

1 34. The method defined in Claim 33 wherein the types comprise 

2 text and background. 

1 35. A method for processing input data comprising: 

2 decomposing the input data into a plurality of decomposition levels 

3 by applying a wavelet transform to the input data; 
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4 performing denoising on coefficients in at least one of the plurality of 

5 decomposition levels; 

6 modifying coefficients in at least two of the plurality of 

7 decomposition levels by scaling coefficients in at least two decomposition 

8 levels using different scale dependent parameters for each of the 

9 decomposition levels; 

1 0 performing renormalization on coefficients; 

1 1 inverse transforming the coefficients. 

1 36. The method defined in Claim 35 wherein the input data 

2 comprises image data. 

1 37. The method defined in Claim 35 wherein modifying 



2 coefficients comprises multiplying each coefficient in one of the 

3 decomposition levels by a first scale dependent parameter and multiplying 

4 each coefficient in another of the decomposition levels by a second scale 

5 dependent parameter. 



1 38. The method defined in Claim 36 wherein each of the different 

2 scale dependent parameters is determined according to the following 

3 formula: 

4 Li = ? ja 



44 

5 where the value of a indicates whether sharpening or smoothing is applied 

6 to coefficients and j indicates the particular scale. 

1 39. The method defined in Claim 38 wherein sharpening is applied 

2 to coefficients if a is less than zero and smoothing is applied to coefficients if 

3 a is greater than zero. 

1 40. The method defined in Claim 35 wherein modifying 

2 coefficients results in smoothing of coefficients for scale dependent 

3 parameters greater than a transition value and results in sharpening of 

4 coefficients for scale dependent parameters less than the threshold value. 

1 41. The method defined in Claim 40 wherein the transition value is 

2 1. 

1 42. The method defined in Claim 35 further comprising 

2 performing simultaneously denoising and sharpening by multiplying all 

3 coefficients in one of the decomposition levels above a predetermined 

4 threshold and setting other coefficients to a value near zero. 



1 



43. The method defined in Claim 42 wherein the value is zero. 
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1 44. The method defined in Claim 35 further comprising 

2 performing denoising as part of scaling coefficients by reducing all 

3 coefficients by a predetermined amount to a value near zero and then 

4 multiplying all coefficients in one of the decomposition levels above a 

5 predetermined threshold and reducing all coefficients by a predetermined 

6 amount to a value near zero. 

1 45. The method defined in Claim 44 wherein the value is zero. 

1 46. The method defined in Claim 35 further comprising coloring 

2 noise that remains after scaling coefficients. 

1 47. The method defined in Claim 35 further company 

2 renormalizing coefficients by applying a scalar to coefficients in at least one 

3 decomposition level. 

1 48. The method defined in Claim 47 wherein renormalizing 

2 coefficients is performed as part of scaling coefficients by multiplying 

3 coefficients in one of the decomposition levels by a scale dependent 

4 parameter chosen to achieve renormalization. 



1 



49. A method for processing input data comprising: 
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2 decomposing the input data into a plurality of decomposition levels 

3 by applying a wavelet transform to the input data; and 

4 magnifying edges more than noise coefficients by multiplying 

5 coefficients in different decomposition levels with different scale dependent 

6 parameters. 

1 50. A method for processing input data comprising: 

2 decomposing the input data into a plurality of decomposition levels 

3 by applying a wavelet transform to the input data; and 

4 smoothing selected coefficients more than non-selected coefficients by 

5 multiplying well in different decomposition levels with different scale 

6 dependent parameters. 

1 51. The method defined in Claim 50 wherein the selected 

2 coefficients comprise background coefficients. 

1 52. The method defined in Claim 50 wherein the selected 

2 coefficients comprises constant regions 



1 

2 
3 



53. An apparatus for processing input data comprising: 
means for decomposing the input data into a plurality of 
decomposition levels by applying a wavelet transform to the input data; and 
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4 means for modifying coefficients in at least two of the plurality of 

5 decomposition levels by scaling coefficients in the at least two 

6 decomposition levels using different scale dependent parameters for each of 

7 the decomposition levels. 

1 54. The apparatus defined in Claim 53 wherein the input data 

2 comprises image data. 

1 55. The apparatus defined in Claim 53 wherein the means for 

2 modifying coefficients comprises means for multiplying each coefficient in 

3 one of the decomposition levels by a first scale dependent parameter and 

4 means for multiplying each coefficient in another of the decomposition 

5 levels by a second scale dependent parameter 



1 56. The apparatus defined in Claim 53 wherein each of the 

2 different scale dependent parameters is determined according to the 

3 following formula: 

4 \i = 2 a 

5 where the value of a indicates whether sharpening or smoothing is applied 

6 to coefficients, and j indicates a particular scale. 
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1 57. The apparatus defined in Claim 56 wherein means for 

2 modifying applies sharpening to coefficients if a is less than zero and applies 

3 smoothing to coefficients if a is greater than zero. 

1 58. The apparatus defined in Claim 53 wherein modifying 



2 coefficients results in smoothing of coefficients for scale dependent 

3 parameters greater than a transition value and results in sharpening of 

4 coefficients for scale dependent parameters less than the threshold value. 



1 59. The apparatus defined in Claim 58 wherein the transition 

2 value is 1. 

1 60. The apparatus defined in Claim 53 further comprising means 

2 for performing an inverse transform on coefficients after scaling has been 

3 performed. 

1 61. The apparatus defined in Claim 53 further comprising means 

2 for denoising after applying the wavelet transform. 

1 62. The apparatus defined in Claim 53 further comprising means 

2 for performing denoising as part of scaling coefficients by multiplying all 

3 coefficients in one of the decomposition levels above a predetermined 

4 threshold and setting other coefficients to a value near zero. 
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1 63. The apparatus defined in Claim 62 wherein the value is zero. 

1 64. The apparatus defined in Claim 53 further comprising 

2 performing denoising as part of scaling coefficients by reducing all 

3 coefficients by a predetermined amount to a value near zero and then 

4 multiplying all coefficients in one of the decomposition levels above a 

5 predetermined threshold and reducing all coefficients by a predetermined 

6 amount to a value near zero. 

1 65. The apparatus defined in Claim 64 wherein the value is zero. 

1 66. The apparatus defined in Claim 53 further comprising means 

2 for renormalizing coefficients. 

1 67. The apparatus defined in Claim 66 wherein the means for 

2 renormalizing coefficients comprises means for applying a scalar to 

3 coefficients in at least one decomposition level. 

1 68. The apparatus defined in Claim 66 wherein the means for 

2 renormalizing coefficients operates as part of scaling coefficients by 

3 multiplying all coefficients in one of the decomposition levels by a scale 

4 dependent parameter chosen to achieve renormalization. 
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1 69. An article of manufacture having one or more recordable 

2 media storing executable instructions thereon which, when executed by one 

3 or more processing devices, cause the one or more processing devices to: 

4 decompose input data into a plurality of decomposition levels by 

5 applying a wavelet transform to the input data; and 

6 modify coefficients in at least two of the plurality of decomposition 

7 levels by scaling coefficients in the at least two decomposition levels using 

8 different scale dependent parameters for each of the decomposition levels. 

1 70. The article of manufacture defined in Claim 69 further 

2 comprising instructions which, when executed by the one or more 

3 processing devices, cause the one or more processing devices to multiply 



4 each coefficient in one of the decomposition levels by a first scale dependent 

5 parameter and multiplying each coefficient in another of the decomposition 

6 levels by a second scale dependent parameter 



1 71. The article of manufacture defined in Claim 69 wherein each of 

2 the different scale dependent parameters is determined according to the 

3 following formula: 

4 ^ = 2° 

5 where the value of a indicates whether sharpening or smoothing is applied 

6 to coefficients and j indicates a particular scale. 
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1 72. The article of manufacture defined in Claim 71 wherein 

2 sharpening is applied to coefficients if a is less than zero and smoothing is 

3 applied to coefficients if a is greater than zero. 

1 73. The article of manufacture defined in Claim 69 wherein 



2 modifying coefficients results in smoothing of coefficients for scale 

3 dependent parameters greater than a transition value and results in 

4 sharpening of coefficients for scale dependent parameters less than the 

5 threshold value. 



1 74. The article of manufacture defined in Claim 73 wherein the 

2 transition value is 1. 

1 75. An apparatus for processing input data comprising: 

2 a forward wavelet filter to convert the input data into coefficients in a 

3 plurality of decomposition levels; 

4 a scaling unit to modifying coefficients in at least two of the plurality 

5 of decomposition levels by scaling coefficients in the at least two 

6 decomposition levels using different scale dependent parameters for each of 

7 the decomposition levels; and 

8 an inverse wavelet filter coupled to the scaling unit. 



1 

2 
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76. The apparatus defined in Claim 75 wherein the input data 
comprises image data. 



1 77. The apparatus defined in Claim 75 wherein the scaling unit 

2 multiplies each coefficient in one of the decomposition levels by a first scale 

3 dependent parameter and multiplies each coefficient in another of the 

4 decomposition levels by a second scale dependent parameter 

1 78. The apparatus defined in Claim 75 wherein each of the 

2 different scale dependent parameters is determined according to the 

3 following formula: 

4 iL ) = 2 ]a 

5 where the value of a indicates whether sharpening or smoothing is applied 

6 to coefficients and j indicates a particular scale. 

1 79. The apparatus defined in Claim 78 wherein the scaling unit 

2 applies sharpening to coefficients if a is less than zero and applies 

3 smoothing to coefficients if a is greater than zero. 

1 80. The apparatus defined in Claim 75 wherein modifying 

2 coefficients results in smoothing of coefficients for scale dependent 

3 parameters greater than a transition value and results in sharpening of 

4 coefficients for scale dependent parameters less than the threshold value. 
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1 82. The apparatus defined in Claim 80 wherein the transition 

2 value is 1. 

1 82. A copier comprising: 

2 an image source; 

3 a classifier unit coupled to the image source; 

4 a scaling unit coupled to the classifier unit comprising 

5 a forward wavelet filter to convert the image data into 

6 coefficients in a plurality of decomposition levels, 

7 a scaling unit to modifying coefficients in at least two of the 

8 plurality of decomposition levels by scaling coefficients in the at least 

9 two decomposition levels using different scale dependent parameters 

1 0 for each of the decomposition levels, 

11 an inverse wavelet filter coupled to the scaling unit; and 

12 a printer coupled to the scaling unit. 

1 83. The copier defined in Claim 82 wherein the scaling unit 

2 multiplies each coefficient in one of the decomposition levels by a first scale 

3 dependent parameter and multiplies each coefficient in another of the 

4 decomposition levels by a second scale dependent parameter 
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1 84. The copier defined in Claim 82 wherein each of the different 

2 scale dependent parameters is determined according to the following 

3 formula: 

4 ti= 2 ,a 

5 where the value of a indicates whether sharpening or smoothing is applied 

6 to coefficients and j indicates a particular scale. 

1 85, The copier defined in Claim 84 wherein the scaling unit applies 

2 sharpening to coefficients if a is less than zero and applies smoothing to 

3 coefficients if a is greater than zero. 

1 86. The copier defined in Claim 82 wherein modifying coefficients 

2 results in smoothing if one of the scale dependent parameters is greater than 

3 a transition value and results in sharpening if one of the scale dependent 

4 parameters is less than the threshold value. 



1 

2 



87. The copier defined in Claim 86 wherein the transition value is 

1. 
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ABSTRACT OF THE DISCLOSURE 

A method and apparatus for processing image data are described. In 
one embodiment, a method of processing image data comprises 
decomposing the image data into multiple decomposition levels by applying 
a wavelet transform to the image data, and modifying coefficients in at least 
two of the decomposition levels by scaling coefficients in theses 
decomposition levels using different scale dependent parameters for each of 
the decomposition levels. 
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Attorney's Docket No.: 74451. P1 03 Patent 
DECLARATION AND POWER OF ATTORNEY FOR PATENT APPLICATION 



As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below, next to my name. 

I believe I am the original, first, and sole inventor (if only one name is listed below) or an original, 
first, and joint inventor (if plural names are listed below) of the subject matter which is claimed and 
for which a patent is sought on the invention entitled 

"MULTISCALE SHARPENING AND SMOOTHING WITH WAVELETS" 



the specification of which 

X is attached hereto. 

was filed on as 

United States Application Number 

or PCT International Application Number 

and was amended on . 

(if applicable) 

I hereby state that I have reviewed and understand the contents of the above-identified 
specification, including the claim(s), as amended by any amendment referred to above. I do not 
know and do not believe that the claimed invention was ever known or used in the United States of 
America before my invention thereof, or patented or described in any printed publication in any 
country before my invention thereof or more than one year prior to this application, that the same 
was not in public use or on sale in the United States of America more than one year prior to this 
application, and that the invention has not been patented or made the subject of an inventor's 
certificate issued before the date of this application in any country foreign to the United States of 
America on an application filed by me or my legal representatives or assigns more than twelve 
months (for a utility patent application) or six months (for a design patent application) prior to this 
application. 

I acknowledge the duty to disclose all information known to me to be material to patentability as 
defined in Title 37, Code of Federal Regulations, Section 1 .56. 

I hereby claim foreign priority benefits under Title 35, United States Code, Section 119(a)-(d), of any 
foreign application(s) for patent or inventor's certificate listed below and have also identified below 
any foreign application for patent or inventor's certificate having a filing date before that of the 
application on which priority is claimed: 
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Prior Foreign Application(s) 



Priority 
Claimed 



(Number) (Country) (Day/Month/Year Filed) Yes No 



(Number) (Country) (Day/Month/Year Filed) Yes No 



(Number) (Country) (Day/Month/Year Filed) Yes No 

I hereby claim the benefit under title 35, United States Code, Section 1 1 9(e) of any United States 
provisional application(s) listed below: 



(Application Number) Filing Date 



(Application Number) Filing Date 



I hereby claim the benefit under Title 35, United States Code, Section 120 of any United States 
application(s) listed below and, insofar as the subject matter of each of the claims of this application 
is not disclosed in the prior United States application in the manner provided by the first paragraph 
of Title 35, United States Code, Section 1 12, 1 acknowledge the duty to disclose all information 
known to me to be material to patentability as defined in Title 37, Code of Federal Regulations, 
Section 1.56 which became available between the filing date of the prior application and the national 
or PCT international filing date of this application: 



(Application Number) Filing Date (Status patented, 

pending, abandoned) 



(Application Number) Filing Date (Status -- patented, 

pending, abandoned) 

I hereby appoint the persons listed on Appendix A hereto (which is incorporated by reference and a 
part of this document) as my respective patent attorneys and patent agents, with full power of 
substitution and revocation, to prosecute this application and to transact all business in the Patent 
and Trademark Office connected herewith. 

Send correspondence to Michael J. Mallie , BLAKELY, SOKOLOFF, TAYLOR & 

(Name of Attorney or Agent) 
ZAFMAN LLP, 12400 Wilshire Boulevard 7th Floor, Los Angeles, California 90025 and direct 

telephone calls to Michael J. Mallie , (408) 720-8598. 

(Name of Attorney or Agent) 
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I hereby declare that all statements made herein of my own knowledge are true and that all 
statements made on information and belief are believed to be true; and further that these 
statements were made with the knowledge that willful false statements and the like so made 
are punishable by fine or imprisonment, or both, under Section 1001 of Title 18 of the United 
States Code and that such willful false statements may jeopardize the validity of the 
application or any patent issued thereon. 

Full Name of Sole/First Inventor Kathrin Berkner 

Inventor's Signature Date _ 

Residence Citizenship 

(City, State) (Country) 

Post Office Address 



Full Name of Second/Joint Inventor „ . 

Inventor's Signature „ Date 

Residence Citizenship 

(City, State) (Country) 

Post Office Address _ 



Full Name of Third/Joint Inventor „ - 

Inventor's Signature Date 

Residence Citizenship 

(City, State) (Country) 

Post Office Address 



Full Name of Fourth/Joint Inventor 

Inventor's Signature _ Date 

Residence Citizenship 

(City, State) (Country) 

Post Office Address 
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APPENDIX A 



William E. Alford, Reg. No. 37,764; Farzad E. Amini, Reg. No. P42.261 ; Aloysius T. C. AuYeung, Reg. No. 
35,432; William Thomas Babbitt, Reg. No. 39,591; Carol F. Barry, Reg. No. 41,600; Jordan Michael 
Becker, Reg. No. 39,602; Bradley J. Bereznak, Reg. No. 33,474; Michael A. Bernadicou, Reg. No. 35,934; 
Roger W. Blakely, Jr., Reg. No. 25,831; Gregory D. Caldwell, Reg. No. 39,926; Ronald C. Card, Reg. No. 
P44.587; Thomas M. Coester, Reg. No. 39,637; Stephen M. De Klerk, under 37 C.F.R. § 10.9(b); Michael 
Anthony DeSanctis, Reg. No. 39,957; Daniel M. De Vos, Reg. No. 37,813; Robert Andrew Diehl, Reg. No. 
40,992; Matthew C. Fagan, Reg. No. 37,542; Tarek N. Fahmi, Reg. No. 41 ,402; James Y. Go, Reg. No. 
40,621; James A. Henry, Reg. No. 41,064; Willmore F. Holbrow III, Reg. No. P41.845; Sheryl Sue 
Holloway, Reg. No. 37,850; George W Hoover II, Reg. No. 32,992; Eric S. Hyman, Reg. No. 30,139; Dag 
H. Johansen, Reg. No. 36,172; William W. Kidd, Reg. No. 31,772; Erica W. Kuo, Reg. No. 42,775; Michael 
J. Mallie, Reg. No. 36,591; Andre L Marais, under 37 C.F.R. § 10.9(b); Paul A. Mendonsa, Reg. No. 
42,879; Darren J. Milliken, Reg. 42,004; Lisa A. Norris, Reg. No. P44.976; Chun M. Ng, Reg. No. 36,878; 
Thien T. Nguyen, Reg. No. 43,835; Thinh V. Nguyen, Reg. No. 42,034; Dennis A. Nicholls, Reg. No. 
42,036; Kimberley G. Nobles, Reg. No. 38,255; Daniel E. Ovanezian, Reg. No. 41,236; Babak Redjaian, 
Reg. No. 42,096; William F. Ryann, Reg. 44,313; James H. Salter, Reg. No. 35,668; William W. Schaal, 
Reg. No. 39,018; James C. Scheller, Reg. No. 31,195; Jeffrey Sam Smith, Reg. No. 39,377; Maria 
McCormack Sobrino, Reg. No. 31,639; Stanley W. Sokoloff, Reg. No. 25,128; Judith A. Szepesi, Reg. No. 
39,393; Vincent P. Tassinari, Reg. No. 42,179; Edwin H. Taylor, Reg. No. 25,129; John F. Travis, Reg. 
No. 43,203; George G. C. Tseng, Reg. No. 41 ,355; Joseph A. Twarowski, Reg. No. 42,191 ; Lester J. 
Vincent, Reg. No. 31,460; Glenn E. Von Tersch, Reg. No. 41,364; John Patrick Ward, Reg. No. 40,216; 
Charles T. J. Weigell, Reg. No. 43,398; Kirk D. Williams, Reg. No. 42,229; James M. Wu, Reg. No. 
P45.241; Steven D. Yates, Reg. No. 42,242; Ben J. Yorks, Reg. No. 33,609; and Norman Zafman, Reg. 
No. 26,250; my patent attorneys, and Andrew C. Chen, Reg. No. 43,544; Justin M. Dillon, Reg. No. 
42,486; Paramita Ghosh, Reg. No. 42,806; and Sang Hui Kim, Reg. No. 40,450; my patent agents, of 
BLAKELY, SOKOLOFF, TAYLOR & ZAFMAN LLP, with offices located at 12400 Wilshire Boulevard, 7th 
Floor, Los Angeles, California 90025, telephone (310) 207-3800, and James R. Thein, Reg. No. 31,710, 
my patent attorney. 
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APPENDIX B 



Title 37, Code of Federal Regulations, Section 1.56 
Duty to Disclose Information Material to Patentability 

(a) A patent by its very nature is affected with a public interest. The public interest is best served, 
and the most effective patent examination occurs when, at the time an application is being examined, the 
Office is aware of and evaluates the teachings of all information material to patentability. Each individual 
associated with the filing and prosecution of a patent application has a duty of candor and good faith in 
dealing with the Office, which includes a duty to disclose to the Office all information known to that individual 
to be material to patentability as defined in this section. The duty to disclosure information exists with respect 
to each pending claim until the claim is cancelled or withdrawn from consideration, or the application becomes 
abandoned. Information material to the patentability of a claim that is cancelled or withdrawn from 
consideration need not be submitted if the information is not material to the patentability of any claim 
remaining under consideration in the application. There is no duty to submit information which is not material 
to the patentability of any existing claim. The duty to disclosure all information known to be material to 
patentability is deemed to be satisfied if all information known to be material to patentability of any claim 
issued in a patent was cited by the Office or submitted to the Office in the manner prescribed by §§1 .97(b)-(d) 
and 1 .98. However, no patent will be granted on an application in connection with which fraud on the Office 
was practiced or attempted or the duty of disclosure was violated through bad faith or intentional misconduct. 
The Office encourages applicants to carefully examine: 

(1) Prior art cited in search reports of a foreign patent office in a counterpart application, and 

(2) The closest information over which individuals associated with the filing or prosecution of a 
patent application believe any pending claim patentably defines, to make sure that any material information 
contained therein is disclosed to the Office. 

(b) Under this section, information is material to patentability when it is not cumulative to 
information already of record or being made or record in the application, and 

(1 ) It establishes, by itself or in combination with other information, a prima facie case of 
unpatentability of a claim; or 

(2) It refutes, or is inconsistent with, a position the applicant takes in: 

(i) Opposing an argument of unpatentability relied on by the Office, or 

(ii) Asserting an argument of patentability. 

A prima facie case of unpatentability is established when the information compels a conclusion that a claim is 
unpatentable under the preponderance of evidence, burden-of-proof standard, giving each term in the claim 
its broadest reasonable construction consistent with the specification, and before any consideration is given to 
evidence which may be submitted in an attempt to establish a contrary conclusion of patentability. 

(c) Individuals associated with the filing or prosecution of a patent application within the 
meaning of this section are: 

(1) Each inventor named in the application; 

(2) Each attorney or agent who prepares or prosecutes the application; and 

(3) Every other person who is substantively involved in the preparation or prosecution of the 
application and who is associated with the inventor, with the assignee or with anyone to whom there is an 
obligation to assign the application. 

(d) Individuals other than the attorney, agent or inventor may comply with this section by 
disclosing information to the attorney, agent, or inventor. 
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